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What is claimed is: 

1 . A method of creating a panorama image from a series of source images 

comprising the steps of: 
5 registering adjoining pairs of images in said series based on common 

features within said adjoining pairs of images; 

estimating a transform between each adjoining pair of images using 
said common features; 

projecting each image onto a designated image in said series using the 
10 estimated transforms associated with said image and with images between said each 
image and said designated image; and 

combining overlapping portions of the projected images to form said 
panorama image. 

15 2. The method of claim 1 wherein during said registering, matching 

corners in adjoining images are determined. 

3. The method of claim 2 wherein said transform is a projective 
transform. 

20 

4. The method of claim 2 wherein after said estimating said transform is 
re-estimated using pixels in said adjoining pairs of images that do not move prior to 
said projecting. 

25 5. The method of claim 1 wherein during said combining, overlapping 

portions of said projected images are frequency blended. 

6. The method of claim 4 wherein said matching corner registration is 
used to error correct said projecting. 

30 

7. The method of claim 6 wherein during said combining, overlapping 
portions of said projected images are frequency blended. 
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8. The method of claim 7 wherein during said estimating, one of a 

projective, affine and translation transform is estimated. 

5 9. The method of claim 1 wherein registering each pair of adjoining 

images I and F includes the steps of: 

extracting features in each of said images I and F corresponding to 
high curvature points therein; 

determining corners adjacent said features; and 
1 0 matching the comers of image I to corresponding corners of image F 

thereby to register said images I and F. 

10. The method of claim 9 wherein during said determining, corners 
within a neighbourhood surrounding said features are detected. 

15 

1 1 . The method of claim 1 0 wherein said determining is performed until a 
threshold number of corners is detected. 

12. The method of claim 1 1 wherein during said matching, each detected 

j 

20 corner in image F is compared with each detected corner in image I to determine 
matching corners in said images I and F. 

13. The method of claim 12 wherein said comparing includes the steps of: 

determining the correlation between each detected corner in image F 

25 with each detected corner in image I to yield a list of corners in which each corner in 
image I has a set of candidate matching corners in image F; 

measuring the likelihood that each of the candidate matching corners in 
said set corresponds to the associated corner in image I; and 

selecting one of the candidate matching corners in said set. 

30 

14. The method of claim 13 wherein during said correlation determining, a 
normalized cross correlation is used to calculate a correlation score between each 
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detected corner in image F with each detected corner in image I, correlation scores 
above a threshold level signifying a candidate matching corner. 

15- The method of claim 14 wherein said correlation determining is 

performed until a threshold number of candidate matching corners is determined 
thereby to form said set. 

16. The method of claim 15 wherein during said measuring, a score of 

matching is used to measure the likelihood that each of the candidate matching 
corners in said set corresponds to the associated corner in image I based on other 
matching corner pairs within a neighbourhood surrounding the corners being 
matched. 



1 7 - The method of claim 9 wherein said estimating includes the steps of: 

selected N pairs of matching corners; and 

solving a set of linear equations modelling said transform thereby to 
estimate a transform detailing the transformation between said matching corners. 

18- The method of claim 17 wherein said estimating further includes the 
steps of: 

applying the estimated transform to non-selected pairs of matching 
corners to evaluate the accuracy of said transform; and 

repeating said selecting, solving and applying iterations to determine 
the most accurate transform. 



1 9- The method of claim 1 8 wherein during said estimating, one of a 
projective, affine and translation transform is estimated. 

20 - The method of claim 19 wherein said transform being estimated is a 
projective transform, if said estimating fails to yield a projective transform having an 
accuracy above a threshold, said estimating is re-performed to determine a translation. 
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2 1 . The method of claim 1 9 wherein said transform being estimated is a 

affine transform, if said estimating fails to yield a projective transform having an 
accuracy above a threshold, said estimating is re-performed to determine a translation. 

5 22. The method of claim 17 wherein following said estimating of the 

transform for each adjoining pair of images, the transforms are re-estimated using 
only pixels in the adjoining pairs of images that do not move. 

23. The method of claim 22 wherein during the projecting, each image is 

10 projected onto the designated image using a projection matrix derived from the 

product of the transforms associated with said each image and with images between 
said each image and said designated image, said projection matrix being error 
corrected using said matching corner registrations. 

1 5 24. The method of claim 23 wherein during said combining, overlapping 

portions of said images are frequency blended. 

25. The method of claim 24 wherein during said frequency blending, 
different frequency content of said overlapping portions are blended with differing 

20 weighting functions. 

26. A method of creating a panorama image from a series of source images 
comprising the steps of: 

registering corners in each adjoining pair of images in said series; 
25 using the registered corners to estimate transforms detailing the 

transformation between each adjoining pair of images; 

re-estimating the transforms using non-moving pixels in the adjoining 
pairs of images; 

multiplying series of transforms to project each image onto the center 
30 image of said series and error correcting the projections using the registered corners; 
and 
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frequency blending the overlapping regions of said projected images to 
yield said panorama image. 

27. The method of claim 26 wherein during said frequency blending, 
different frequency content of said overlapping regions are blended with differing 
weighting functions. 

28. The method of claim 26 wherein during said estimating and re- 
estimating, projective transforms are estimated. 

29. The method of claim 28 wherein during said estimating if projective 
transforms having an accuracy above a threshold cannot be determined, translations 
are estimated and re-estimated. 

30. The method of claim 26 wherein during said estimating and re- 
estimating, affine transforms are estimated. 

3 1 . The method of claim 30 wherein during said estimating if projective 
transforms having an accuracy above a threshold cannot be determined, translations 
are estimated and re-estimated. 

32. A digital image editing tool for creating a panorama image from a 
series of source images comprising: 

means for registering adjoining pairs of images in said series based on 
common features within said adjoining pairs of images; 

means for estimating transforms between adjoining pairs of images 
using said common features; 

means for projecting each image onto a designated image in said series 
using the estimated transforms associated with said image and with images between 
said each image and said designated image; and 

means for combining overlapping portions of the projected images to 
form said panorama image. 
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33. A digital imaging editing tool according to claim 32 wherein said 

means for registering matches corners in adjoining pairs of images. 

5 34. A digital image editing tool according to claim 33 wherein said means 

for estimating re-estimates each transform using pixels in said adjoining pairs of 
images that do not move. 

35. A digital image editing tool according to claim 34 wherein said means 
1 0 for combining frequency blends overlapping portions of said projected images. 

V 

36. A digital image editing tool according to claim 35 wherein said means 
for estimating estimates one of a projective, affine and translation transform. 

15 37. A computer readable medium embodying a computer program for 

creating a panorama image from a series of source images, said computer program 
including: 

computer program code for registering adjoining pairs of images in 
said series based on common features within said adjoining pairs of images; 
20 computer program code for estimating a transform between each 

adjoining pair of images using said common features; 

computer program code for projecting each image onto a designated 
image in said series using the estimated transforms associated with said image and 
with images between said each image and said designated image; and 
25 computer program code for combining overlapping portions of the 

projected images to form said panorama image. 

38. A computer readable medium embodying a computer program for 

creating a panorama image from a series of source images, said computer program 
30 including: 

computer program code for registering corners in each adjoining pair 
of images in said series; 
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computer program code for using the registered corners to estimate 
transforms detailing the transformation between each adjoining pair of images; 

computer program code for re-estimating the transforms using non- 
moving pixels in the adjoining pairs of images; 
5 computer program code for multiplying series of transforms to project 

each image onto the center image of said series and error correcting the projections 
using the registered comers; and 

computer program code for frequency blending the overlapping 
regions of said projected images to yield said panorama image. 

10 
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